Structure of completely positive quantum master equations with memory kernel 
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Semi-Markov processes represent a well known and widely used class of random processes in 
classical probability theory. Here, we develop an extension of this type of non-Markovian dynamics 
to the quantum regime. This extension is demonstrated to yield quantum master equations with 
memory kernels which allow the formulation of explicit conditions for the complete positivity of 
the corresponding quantum dynamical maps, thus leading to important insights into the structural 
characterization of the non-Markovian quantum dynamics of open systems. Explicit examples are 
analyzed in detail. 
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I. INTRODUCTION 

Dissipation, damping and dephasing phenomena in 
the dynamics of open quantum systems can often be 
modelled through the standard techniques of the the- 
ory of quantum Markov processes in which the open 
system's density matrix is governed by a quantum mas- 
ter equation with Lindblad structure P, However, 
in the description of complex quantum mechanical sys- 
tems one encounters in many physically relevant cases 
a complicated non-Markovian behavior that cannot 
be described by means of these standard methods. In 
fact, non-Markovian systems feature strong memory ef- 
fects, finite revival times caused by long-range correla- 
tion functions, and non-exponential damping and de- 
coherence which generally render impossible a theoret- 
ical treatment through a dynamical semigroup (see, e.g., 
Refs. I, i, i, 0, i, i Ea, EH, in, [II). As a conse- 
quence the analysis of non-Markovian quantum dynamics 
is extremely demanding. Even in the regime of classi- 
cal probability theory it is difficult to formulate general 
equations of motion for the probability distributions of 
non-Markovian processes. In quantum mechanics the sit- 
uation is even more involved since the classical condition 
of the preservation of the positivity for the distribution 
functions is to be replaced by the stronger condition of 
complete positivity of the resulting quantum dynamical 
maps. 

In classical probability theory and the theory of 
stochastic processes there exists however a well estab- 
lished and widely used class of non-Markovian processes, 
narnely the class of semi-Markov processes [ij, [H, [l^, 
[TtI . [18| . It is thus natural to investigate possible gener- 
alizations of this type of processes to the quantum case. 
Recently we have proposed such a generalization, lead- 
ing to the concept of a quantum semi-Markov process 
In the present paper we elaborate the details of 



this approach and indicate a number of further exam- 
ples of applications of the theory. The class of quantum 
processes constructed here is demonstrated to yield gen- 
eralized master equations with memory kernel, and to al- 
low the mathematical formulation of necessary and even 
necessary and sufficient conditions which ensure the com- 
plete positivity of the corresponding quantum dynamical 
maps. Indeed the formulation of such conditions for non- 
Markovian master equations is a highly nontrivial task 

The paper is organized as follows. Section [Til contains 
a short introduction into the theory of classical semi- 
Markov processes. We define the fundamental quantities, 
such as the semi-Markov matrix, the survival probabili- 
ties and the waiting time distributions, derive the gener- 
alized master equation and the structure of the classical 
memory kernel, and discuss several examples for clas- 
sical memory functions and waiting time distributions. 
The generalization of these concepts to the quantum case 
is developed in Sec. IIIII We introduce a class of quan- 
tum master equations with memory kernel and formu- 
late explicitly the corresponding conditions for the com- 
plete positivity of the quantum time evolution. A number 
of examples and applications is also discussed. Finally, 
some conclusions are drawn in Sec. IIVI 
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II. CLASSICAL SEMI-MARKOV PROCESSES 

In the present section we want to give a brief intro- 
duction to classical semi-Markov processes, focusing on 
the basic quantities necessary in order to describe and 
uniquely determine such processes. In particular build- 
ing on these quantities we will be able to explicitly de- 
rive a generalized master equation for the time evolution 
of the conditional transition probabilities of the process, 
which is the starting point for a generalization to the 
quantum case. General references to the subject are typ- 
ically found in the mathematics literature (see 
also the monograph 17]), even though examples of classi- 
cal semi-Markov processes have been extensively studied 
in the physics literature under the name continuous time 
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random walk (see [l^ for a comprehensive treatment and 
references therein). 



A. Semi-Markov matrix 

Semi-Markov processes naturally generalize Markov 
processes by combining the theory of Markov chains and 
of renewal processes [23|. In a Markov chain a system 
jumps among different states according to certain prob- 
abilities depending on departure and arrival state, the 
time spent in a given state being immaterial. A renewal 
process is instead a counting process in which the times 
among successive events are independent identically dis- 
tributed random variables characterized by an arbitrary 
common waiting time distribution, the adjective renewal 
stressing the fact that the process starts anew at every 
step. If this waiting time distribution is of exponential 
type one obtains as a special case of renewal process a 
Poisson process, in fact the exponential is the only memo- 
ryless distribution leading to a Markov counting process. 
In this case knowing that a system has already been in a 
state for a given amount of time provides no additional 
information on the expected time of the next jump. By 
combining the two features a semi-Markov process de- 
scribes a system moving among different states according 
to fixed transition probabilities, so that the sequence of 
visited states forms a Markov chain, spending a random 
time in each state. These random sojourn times however 
are described by a waiting time distribution which is not 
necessarily of exponential type, as in a Markov process, 
and which might depend both on the present state and 
on the immediately following one. If one only consid- 
ers the different states visited by a semi-Markov process 
one recovers a Markov chain, while if the state space is 
reduced to a single point one recovers a renewal process. 

A semi-Markov process is uniquely determined intro- 
ducing a so-called semi-Markov matrix Qmn{T), which 
gives the probabilities for a jump from a state n to a state 
m in a time r. More precisely, given that the process ar- 
rived in the state n at time t, Qmn{T) denotes the prob- 
ability that it jumps to the next state m no later than 
time t + T. The semi-Markov matrix can be expressed 
through the corresponding densities QmniT) defined by 



dQrnnir) = (?„i„(r)dT, 



(1) 



which represent a collection of state dependent waiting 
time distributions. If a jump eventually occurs with cer- 
tainty the following normalization holds 



™ "'0 



(2) 



In terms of the state dependent waiting time distribution 
Qmn{T) one can naturally introduce the survival proba- 
bility 



g„(T) = l-^/ dsqjnn{s), 

™ "'0 



(3) 



that is the probability not to have left state n by time r. 
For the special case in which the waiting time distribution 
for the next jump to take place does only depend on the 
initial state one has the factorization 



(4) 



with TTrnn the transition probabilities of the correspond- 
ing Markov chain satisfying ~ /«(''") ^ 
normalized waiting time distribution. Correspondingly 
one also has the factorization Qmn{T) = 7rm„ i^„(r), with 
Fn (r) the cumulative distribution function providing the 
probability of a jump out of state n in a time r. If the 
system can get stuck in some state n, the corresponding 
fn{T) is not normalized to one and ([2]) becomes a strict 
inequality. 

It is of interest to consider the form of qmn{T) corre- 
sponding to a Markov process. Such a process is recov- 
ered for a factorizing expression of the form 



(5) 



with corresponding survival probability given by 

5n(r) = e-^"^ (6) 

Denoting by h{u) the Laplace transform of a function 
/i(r) defined on the positive real line, 



n+oo 

h{u) = j dr h{T)e' 



(7) 



we observe for later use that in Laplace representa- 
tion semi-Markov matrix and survival probability for a 
Markov process read 



All 



'U + Xn 



and 



gn = 



U + Xr, 



(8) 



(9) 



respectively. This choice corresponds to an exponential 
waiting time distribution fn{T) — AnC^^""^, leading to 
the following memoryless property. Let us denote by r„ 
the random variable giving the time spent in state n, and 
let us consider the conditional probability for a jump out 
of n to take place after a time t+s, given that no jump has 
taken place up to time s, one immediately has from ([6]) 

P{r„ > t + .|r„ > .} = -^^J; ^ e-^-\ (10) 

P{r„ > s\ 

so that this conditional probability does not depend on 
the time already spent in site n. This lack of memory 
only holds for an exponential distribution, whose survival 
probability is given by the simple exponential ([5]). For all 
other possible choices of the semi-Markov matrix semi- 
Markov processes are indeed non-Markovian. 
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B. Generalized master equation 

We now want to obtain a generalized master equation 
for the conditional transition probabilities of a classical 
semi-Markov process starting from the central quantity 
given by the semi-Markov matrix qmn{T). Such a gen- 
eralized master equation is the counterpart for the non- 
Markovian case of the Pauli master equation, which is 
reobtained as a special case when memory effects are ab- 
sent. To do this we will follow a straightforward and 
intuitive path, exploiting an analog of the Kolmogorov 
forward equation for standard Markov processes, written 
in Laplace representation. Another slightly more indi- 
rect route can be found in (2^ 1 , which already represented 
an endeavour to give a simple derivation of the general- 
ized master equation. The point is not entirely trivial, 
as can be seen from the amount of literature devoted in 
the physics community to relate continuous time random 
walks, which provide examples of semi-Markov processes, 
to generalized master equations (see, e. g., [23| and ref- 
erences therein). 

As a starting point we consider the Kolmogorov for- 
ward equations for a Markov process, which can be im- 
mediately written down using arguments of probabilistic 
nature [l5|. We denote by Tmn{t) the conditional tran- 
sition probability, i. e. the probability for the process to 
be in the state m at time t under the condition that it 
started in state n at time zero. These quantities obey 
the equation 



-^mn(0 — 



(11) 

the two terms on the r.h.s corresponding to contributions 
in which the system has performed zero or at least one 
jump respectively. Thus the first expression on the r.h.s. 
gives the probability not to have left state n, expressed 
by means of the survival probability of a Markov process 
gniT) = e""^""^. The second expression argues on the last 
jump performed, summing over paths in which the sys- 
tem goes from state n to a state fc in a time r and makes 
at this point his last jump from fc to m, with probabil- 
ity density TTmk^k, dwelling there for the remaining time 
t — T. This equation is most easily dealt with in Laplace 
representation, coming to 

^m.n9m{u) + ^ gm{u)TTrak>^kTkn{u) , (12) 



We have thus recast the Kolmogorov forward equations 
in a form where only the semi-Markov matrix and the 
related survival probability appear, starting from their 
specific expressions for the case of a Markov process. 
We now extend these equations to allow for a general 
semi-Markov matrix, thus obtaining a set of equations 
playing the role of Kolmogorov forward equations for a 
semi-Markov process, first obtained by Feller [1^]. Re- 
calling that due to Eq. ([3]) the general expression for the 
Laplace transform of the survival probability in terms of 
the semi-Markov matrix is given by 



9n{u) 



1 - Em9"m(w) 



(15) 



and subtracting the term ^j.qkm{u)T„-in{u) from both 
sides of Eq. (fT^ one comes to 



f,nn{u)[l 



k 



(u) 



+ 5m (w) > - , . Tkn[U) - 

k V 



{u)Tmn{u), (16) 



and finally diving by gmiu) one obtains 



ufrnniu) ~ Smn = ^ [VF„ife (u)Tfe„ (u) - Wkmiu)fmniu)]. 
k 

(17) 

Taking the inverse Laplace transformation of this equa- 
tion and using T'„i„(0) — Smn one is thus immediately led 
to the generalized master equation 

jjmnit)^ dTY,\Wmk{T)Tkn{t-T) 

-Wkm{T)Tmn{t~T)\. (18) 

Denoting by P„ {t) the probability to be in state n at time 
t starting from a fixed state at the initial time zero one 
can also write this equation as 

j^Pjt)^ f dTY,[Wnrn{r)Pm{t-T) 

^ m 

- W„„(r)P„(t-r)l. (19) 



and further recalling ([8|) and ([9]) 

Tmn{u) = Smngmiu) + .9m (m) } fkn{u), (13) 

^ gk[u) 

where the ratio between Laplace transform of semi- 
Markov matrix and survival probability appears, which 
we will generally denote as 



Wmkiu) 



gk{u) 



(14) 



C. Classical Memory kernel 

The matrix of functions Wnm (t) can be naturally called 
classical memory kernel, and is given by the inverse 
Laplace transform of Eq. , expressed in the time do- 
main through 



gmn(T) = / dsWmn{s)gnir-s) ^ (Wmn*gn)iT), (20) 

/o 
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where * denotes as usual the convolution product, or 
more compactly in terms of the Laplace transformed 
quantities 



Wmn{u) 



qniniu) Uqmniu) 



9n{u) 



(21) 



As one immediately checks, in the Markovian case the 
memory kernel is given by a matrix of positive constants 
times a delta function 



with 



thus satisfying 



W™„(t) =r„„2<5(i), 



>o. 



(22) 



(23) 



(24) 



leading to the usual Pauli master equation 
d 



dt 



Pn{t) = 2^ [TnmPm{t) ~ T ^nPn{t)] ■ (25) 



Note in particular that the positivity and the normaliza- 
tion of the coefficients Tnm naturally allow an interpre- 
tation as transition probabilities per unit time, i. e., as 
transition rates, a simple picture which is no more avail- 
able in the general case. In fact, the functions Wnm{t) 
can take on negative values even when obtained from a 
well-defined semi-Markov matrix, as we will show with 
simple examples. 

To do this let us first consider in detail the situation 
described in Eq. (jl]), corresponding to factorized contri- 
butions in the semi-Markov matrix [23| . We note that in 
this case the survival probability simply reads 



ff«(T) = 1 - / dsfn{s), 
Jo 



(26) 



implying for the memory kernel a factorized expression 
of the form 



(27) 



where the memory functions fcm(t) relate waiting time 
distribution /ti(t) and survival probability gn{T) through 
the integral relation 

fn{r) = / dskn{s)gn{T - s) = (fc„ * g„)(T), (28) 
Jo 

corresponding to Eq. ([20| . Also in this case it is conve- 
nient to express these identities in the Laplace domain, 
so that one has 



9n{u) 



l-fniu) 



(29) 



leading to a factorized expression for the memory kernel 

fn{u) 



gn[U) 



(30) 



which together with Eq. ((29)) yields the following one-to- 
one correspondence between fc„ (u) and /„ {u) , 



Liu) = 

1 - fn(u) 



(31) 



This relation provides the most direct way to obtain the 
memory function fc„(i) given a certain waiting time dis- 
tribution fn(t). 

It immediately appears from Eq. (|27|) that the positiv- 
ity of the matrix elements of the memory kernel for the 
considered class of factorized expressions depends on the 
positivity of the memory functions fc„(t). We will now 
consider simple and natural examples of waiting time dis- 
tributions leading to negative memory functions, at vari- 
ance with what happens in the Markovian case. To this 
end the dependence on the index n is not relevant, since 
we are only interested in showing that a well-defined wait- 
ing time distribution /(r) associated to a fixed state of 
the system can correspond to a negative function k{t). 
This point will turn out to be of particular relevance in 
the quantum extension of the model, both in order to 
identify the class of admissible memory kernels together 
with possible pitfalls, and to make contact with relevant 
physical models. 

Let us consider a general class of waiting time distribu- 
tions given by the so-called special Erlang distributions 
(of order a G N) 



/('^)(r) = A 



(XtY 



-At 



'(«-!)! ' 
whose Laplace transform is simply given by 

A 



u + X 



(32) 



(33) 



Such a distribution describes a random variable given 
by the sum of a independent identically distributed ex- 
ponential random variables with the same positive pa- 
rameter A. Exploiting the relation (|3ip and inverting the 
Laplace transform, which is easily done since we are deal- 
ing with rational functions, one obtains for the first three 



(34) 
(35) 

-3At/2 



(36) 

so that for a = 3 one indeed has negative contributions in 
the memory kernel. On similar grounds one can consider 



orders 










= Ae-^^ 




= 2XS{t) 




= AVe-^^ 




= A^e-^^* 




\3 

2 


k^^^t) 


^ — sin(\/3At/2)e 
v3 
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a sum of exponential random variables characterized by 
different parameters, still obtaining a rational function 
for the Laplace transform of the waiting time distribu- 
tions, corresponding to so-called generalized Erlang dis- 
tributions. Their expression is given by 



A, — Xi 



(37) 



and correspondingly 

a 



u + Xi 



(38) 



In this case for a = 1 one is obviously back to a simple 
exponential distribution, while for a — 2 the waiting time 
distribution is a difference of two exponential functions 



/(2)(t) 



A1A2 



-Air 



-A2T\ 



(39) 



A2 — Ai 

leading to the following positive memory function 

fc(2)(t)-AiA2e-(^i+^^)*. (40) 

For a = 3 depending on the value of the three parameters 
{Ai}i=i...3 the memory function can become oscillatory, 
thus taking on negative values, according to 



k{3)i't) = A1A2A3- 



A. - A_ 



(41) 



with 



1 



A± = _^1±^±^ ± ±y(A; - A2 - A3)2 - 4A2A3. 

(42) 

A complementary example is obtained taking rather 
than a sum of exponential random variables a single ran- 
dom variable with a waiting time distribution given by 
a multi-exponential, that is to say a convex mixture of 
exponential distributions 



Already for the simplest nontrivial case given by a bi- 
exponential distribution 



/(T)=pAie-^^" + (l-p)A2e 



(44) 



with < p < 1, one obtains a memory function taking 
on negative values according to 



k{t) = (A) 



2d{t) - 



AA^ 



'(pA2-(^(l-p)Ai)t 



(45) 



where with obvious notation (A) = pAi -|- (1 — p)A2 and 
AA^ = (A^) — (A)'^. It is important to stress that the 
function given by Eq. p7p cannot be interpreted as a 



multi-exponential distribution, since the weights in the 
sum over i are not always positive. Indeed the situations 
described by Erlang or multi-exponential distributions 
correspond to two complementary pictures. In both cases 
the system moves from one state to another in various 
unobserved stages or steps, each taking an exponentially 
distributed time. In the case of an Erlang distribution 
such as Eqs. ([5^ or ([57)1 however the different steps are 
taken in series, while for a multi-exponential distribution 
as given by Eq. ([^5]) the different stages are entered in 
parallel, following one of the available possibilities, each 
with its own weight. In both cases one describes a non- 
Markovian situation in terms of elementary Markovian 
building blocks described by exponential distributions, 
the non-Markovian features appearing because one does 
not have information on the fictitious intermediate steps. 
For a suitable choice of weights and parameters one can 
approximate any distribution by combination of stages in 
series and in parallel, so that these examples are in fact 
quite representative. 



III. QUANTUM SEMI-MARKOV PROCESSES 

A. Quantum Markov processes 

In the Markovian regime the dynamics of the density 
matrix p{t) of an open quantum system is governed by a 
master equation of the relatively simple form of a first- 
order differential equation. 



-p{t) = Cp{t), 



(46) 



where £ is a time-independent infinitesimal generator 
with the general structure 



(47) 



The Hamiltonian H describes the coherent part of the 
time evolution, while the Aa are operators representing 
the various decay modes, with 7a > the corresponding 
positive decay rates. The solution of Eq. can be 
written in terms of a linear map V{t) = exjp{Ct) that 
transforms the initial state p{0) into the state p{t) at 
time t > 0, 



p(o) p{t) = y(t)p(o). 



(48) 



The map V{t) is a well-defined quantum dynamical map 
provided it preserves trace and positivity when applied 
to a general initial state p(0). This is granted if V{t) is 
a completely positive map, in accordance with general 
physical principles [1]. This property implies that it can 
be written in the Kraus form 



(49) 
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where in order to grant preservation of the trace 
the operators ^ait) have the property that the sum 
J2a^ai^)^a{t) is equal to the unit operator. Hence, 
V(t) represents a completely positive dynamical semi- 
group known as quantum Markov process. The master 
equation (|46|) leads to such a semigroup if and only if the 
generator is of the form of Eq. (|T7)l . This is the content of 
the celebrated Gorini-Kossakowski-Sudarshan-Lindblad 
theorem [l], 0], of paramount importance in both fun- 
damental and phenomenological approaches to the de- 
scription of irreversible dynamics in quantum mechanics 
i. 

For the case in which one has a closed system of equa- 
tions for the populations P„(t) = {n\p{t)\n) in a fixed or- 
thonormal basis one recovers from Eq. (|46p and Eq. ([171) 
the Pauli master equation (PS)) . This justifies the no- 
tion of a quantum Markov process and provides a direct 
connection to a classical Markov process. 



that is to say of the form given by Eq. ((47|) apart from the 
time dependence of the operators (t) and of the real 
functions 7q(t). As previously done in the Markovian 
case let us consider the situation in which the populations 
obey a closed system of equations of motion, which then 
takes the form (fT9|l of the generalized master equation 
for a classical semi-Markov process, where the memory 
kernel is given by 

W„m{T) - ^7a(T)|(n|A„(T)|TO)|2. (53) 

a 

Thus, whenever the populations obey closed equations, 
Eq. yields the classical Markovian master equation 
(fSt)) . while Eq. ((SO]) with the kernel ([52]) leads under the 
same conditions to the generalized master equation p9|) 
for a classical semi-Markov process. This justifies the 
name quantum semi-Markov process. 



B. Master equations with memory kernel 



C. Conditions for complete positivity 



A natural non-Markovian generalization of Eq. (j46|) is 
given by the integrodifferential equation 



dt 



Pit) 



dr IC{T)p{t 



(50) 



Here quantum memory effects are taken into account 
through the introduction of the memory kernel IC{t), 
which means that the rate of change of the state p{t) 
at time t depends on the states p{t — t) at previous 
times t — T. Equations of the form ([50|) typically arise 
in the standard Nakajima-Zwanzig projection operator 
technique [2^, [23|. As an important limiting case, the 
Markovian master equation (|46p is recovered for a mem- 
ory kernel proportional to a ^-function. 



/C(t) = 2S{t)C. 



(51) 



To be physically acceptable the superoperator JC{t) ap- 
pearing in Eq. (|50p must lead to a completely positive 
quantum dynamical map V{t). The general structural 
characterization of the memory kernels with this prop- 
erty is an unsolved problem of central importance in the 
field of non-Markovian quantum dynamics [1, [13, [2^, |2^ . 
In fact, even the most simple and natural choices for /C(r) 
can lead to unphysical results [1, [l^ . Here we will con- 
struct a class of memory kernels which arises naturally 
as a quantum mechanical generalization of the classical 
semi-Markov processes, and allows the formulation of cri- 
teria that guarantee complete positivity. 

We consider memory kernels with the general structure 

/C(r)p = -*[i/(r),p]-i^7a(r){Al(r)A„(r),p} 



-J2^c.{T)A^{T)pAi{T), 



(52) 



Our next goal is the formulation of sufhcient conditions 
that guarantee the complete positivity of the dynamical 
map V(t) corresponding to the non-Markovian master 
equation defined by Eqs. ((50)) and ([52]), no longer assum- 
ing that closed equations for the populations exist. 



1. Quantum dynamical map 

The dynamical map V{t) corresponding to the master 
equation (|50p is defined as the solution of the integrodif- 
ferential equation 



d r* 

V{t) = / dTlC{T)V{t-T) 



dt 



(54) 



with the initial condition V{0) = I, where / denotes the 
identity map. Following Ref. [s^l let us decompose the 
memory kernel as 

/C(t) = i?(r) + C(r), (55) 
where the superoperators B{t) and C(r) are defined by 
Bir)p = ^7a(r)yl.(T)pAt(r), (56) 

a 

C{t)p = -*[i/(r),p] 

-\Y.l.{T){Ai{T)A^{T),p}. (57) 

a 

We further introduce the map Vb [t) as the solution of the 
equation 



(58) 
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with the initial condition Vo(0) = I. The Laplace trans- 
formation of Eqs. ((5i|) and (|55)) yields 



V(u) 



1 



1 



(59) 



u — K,{u) M — C(m) 

from which we get the Dyson-type identity 

V{u) = %{u) + Vb(w)S(u)y(w). (60) 

Transforming back to the time domain we obtain the 
equation 



V(t)^Vo{t) + {Vo*B*V){t). 



(61) 



Regarding formally the superoperator B{t) as a pertur- 
bation and iterating Eq. (|6T|) one finds that the full dy- 
namical map V{t) can be represented as a series, 

V{t) = V^(t) + {V^*B*V^){t) 

+ (Vo*B*Vo*B*V^){t) + (62) 

which turns out to be a useful relation in the formulation 
of appropriate conditions for complete positivity. 



2. Sufficient conditions for complete positivity 

Let us first assume that the quantities 7q(t) are posi- 
tive functions, which means that the superoperator B(t) 
defined by Eq. ([56]) is completely positive. Since the 
property of the complete positivity is preserved under ad- 
dition and convolution, the representation (|62p then tells 
us that the full dynamical map V{t) is completely posi- 
tive if the map Vo(t) is completely positive. To bring this 
condition into an explicit form let us assume further that 
the Hermitian operators H{t) and 7q,(t)AJj,(t)Aq,(t) 
are diagonal in a time-independent orthonormal basis 
{|n)} for the underlying Hilbert space, i. e. we have 

H{t) = Y.en{r)\n){n\, (63) 

n 

^7a(r)At (r)A„(r) ^ ^ fc„(r)|n) (64) 

a n 

with in general time-dependent eigenvalues e„(T) and 
kn (r) . Note that the positivity of the 7q, (r) implies that 
the eigenvalues fc„(r) must be positive as well. 
Equation ((58| can now be solved to obtain 



Vo{t)p{Q) =Y.9nra{t)\n){n\pm7n){ml (65) 

nm 

where the functions gnm{i) are the solutions of 



gmn(i) dr [z„(t) + z*^{t)] gn,n{t - t), (66) 

Jo 

corresponding to the initial conditions .9„m(0) = 1, and 



Equation ([65)1 can be proven as follows. First, one shows 
that C(t) (|n)(m|) = -[znir) + z^{T)]\n){m\. Using this 
relation and differentiating Eq. ([58]) one easily demon- 
strates that the expression ([55|l indeed represents the de- 
sired solution. 

It is important to notice that the functions gnn{t) do 
actually coincide with the survival probabilities gn{t) in- 
troduced in Eq. (|26p. In fact, for n = m we get from 
Eq. §^ 



(t) = - / dTk„{T)gnnit - t). 



(68) 



The survival probabilities satisfy the same equation as 
can be seen by taking the time derivative of Eq. (|26p and 
using Eq. ([28]) . 

One easily verifies that the representation (|65p can be 
brought into the Kraus form (|49| if and only if the ma- 
trix G{t) with the elements gnm{t) is positive. Thus, we 
arrive at a sufficient condition for complete positivity: 
The quantum dynamical map V{t) corresponding to the 
non-Markovian master equation (|50p with the memory 
kernel (|52p is completely positive if the condition 



G{t) = ignrnit)) > 



(69) 



is fulfilled. 

A necessary condition for ([69| to hold is the positiv- 
ity of the diagonal elements gnn{t) of G{t) which coin- 
cide with the survival probabilities, gn{t) = gnn{t)- This 
necessary condition in turn implies the positivity of the 
functions fn{t) as can be seen immediately from Eq. (j28p 
because fc„(t) > 0. Condition ([55]) therefore implies that 
the functions /n(^) allow an interpretation as true wait- 
ing time distributions. The positivity of the matrix G{t) 
therefore represents a natural quantum generalization of 
the classical conditions for a semi-Markov process. 



3. Markovian limit and Lindblad theorem 

In the Markovian limit expressed by Eq. ([5T|) we must 
have fc„(r) = 2fc"5(T) and £„(t) = 2e°5(T), such that 
Zn{T) — 2z°(5(t). Equation ([55)1 then reduces to the time- 
local equation 



i(0 (^n ^" ^rri) 9nmit)j 



which is easily solved to yield 

gnmit) = hn{t)h*^{t), h„{t) 



(70) 



(71) 



^nir) = -knir) + ien(r). 



(67) 



Since a matrix with elements of this form is always posi- 
tive we conclude that condition ([69| is automatically sat- 
isfied. It follows from our results that the corresponding 
quantum dynamical map represents a completely positive 
semigroup. Hence, we see that our formulation correctly 
describes the transition to the Markovian limit and that 
it contains as a special case the "if" -part of the Lindblad 
theorem. 
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4- Negative memory functions 

Up to now we have considered the case that the su- 
peroperator B(t) is completely positive which led to the 
sufficient condition for the complete positivity of the 
dynamical map. The complete positivity oi B{t) implies 
that the memory functions must be positive, fc„(<) > 0. 
However, in many physical relevant applications these 
functions can take on negative values. 

To include cases with negative kernel functions we 
consider the following general class of memory kernels. 
We use again the decomposition of the form given by 
Eq. where C(t) is given by the expressions ([57)) . 

(I63p and (|64p . However, we now drop the condition that 
the map B(t) is completely positive, supposing instead 
that it takes the following general form, 

B(r) =^fc„(r)B„, (72) 

n 

where the fc„(T) are real functions, not necessarily pos- 
itive, and the i?„ are completely positive and time- 
independent maps. The full memory kernel can thus be 
written as 

/C(r)p = -i[H{T),p] + K{t) (Ur^p - i {\n){nlp}\ . 

. . . 

Without the assumption of the complete positivity of 
B{t) the complete positivity of Vo(t) is generally not suf- 
ficient for the complete positivity of the dynamical map 
V{t). However, we can conclude from the representation 
(l62)l that V{t) is completely positive if both Vo{t) and 
(Vb * B){t) are completely positive. We have 

(Fo * B){t)p - fn^{t)\n){n\Bip\m){ml (74) 

Inm 

where 

iLnit)^ I dTki{T)gr,ra{t-T). (75) 

The map (|74l) is completely positive if for all / the matrix 
with elements fnmi'^) positive, 

F\t) = ifl^it))>0. (76) 

Summarizing, we have shown that the quantum dynami- 
cal map V{t) is completely positive if the conditions ([M]) 
and ^ are fulfilled. 

We can again provide the connection of the obtained 
results to the interpretation in terms a classical semi- 
Markov process. In fact, a necessary condition for ([75)1 
is the positivity of the functions /,"„(/:) which coincide 
with the functions /„(t). Conditions and ([7S)) thus 
imply that 5,1 (0 fn{t) can be interpreted as survival 
probability and as waiting time distribution for a classi- 
cal semi-Markov process, respectively. These conditions 
therefore represent a generalization of the classical con- 
ditions to the quantum case for memory functions fc„(i) 
that are allowed to take on negative values. 



D. Examples 

To illustrate the theory developed here and the various 
conditions for the complete positivity of the dynamical 
map we will now introduce a few examples. In particular 
we will consider a structure for the memory kernel which 
encompasses and generalizes a model recently studied in 
the literature for the description of memory effects [3, 
[2l| . For this class of memory kernels we are in particular 
able to give necessary and sufficient conditions for the 
complete positivity of the dynamical evolution. 

1. Lattice systems 
Let us consider the following memory kernel, 

71 

+ ^7r™„fc„(r)|m)(7i|p|n)(m|. (77) 

mn 

The special feature of this kernel is given by the fact that 
it leads to closed equations of motion for the popula- 
tions Pn(t) = Pnn{t) = {'n\p{t)\n) and for the coherences 
Pnm{t) = {n\p{t)\m), n ^ m. In fact, we find from the 
master equation with the above kernel that the coher- 
ences satisfy the same equation as the quantities gnmit), 
namely Eq. (j66p . Taking into account the initial condi- 
tions we thus have 

Pnm \^} — Qnra (i)p„m(0), n^m. (78) 

On the other hand, the populations are found to obey 
the generalized master equation (fT9|) with Wnm{T) = 
T^nrakmir). We assume that this master equation de- 
scribes a classical semi-Markov process and denote by 
Tnm{t) the corresponding conditional transition proba- 
bility. The diagonals of the density matrix can therefore 
be written as 

Pnn{t) = y^T'«m(^)Pmm(0)- (79) 

m 

Thus, the memory kernel (|77p may be viewed as describ- 
ing a quantum particle moving on a lattice with sites la- 
belled by 71. The dynamics of the populations is modelled 
through a semi-Markov process with transition probabil- 
ities TTnm and arbitrary waiting time distributions /n(i), 
while the pnm{t) describe the quantum coherences be- 
tween different sites n and m. 

With the help of Eqs. (|75)) and ([79)1 we can immediately 
construct the quantum dynamical map, 

V{t)piO) = J2 9nm{t)\n){n\piO)\m){m\ 

+ YTnm{t)\n){m\p{0)\m){n\. (80) 
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Let us introduce a matrix G{t) — [gnm{t)) whose ele- 
ments are defined by 



(81) 



The off-diagonal elements of G{t) thus coincide with 
those of the matrix G{t) introduced earlier, while the 
diagonals of G{t) are given by the conditional transition 
probabilities T„„(t). Then we can rewrite Eq. ([SO]) as 

V{t)p{Q) = 5].g„™(i)|n>(n|p(0)|m)(TO| 

nm 

+ Y.T^^{t)\n){m\pmm){n\. (82) 

This is an exact formal representation for the full quan- 
tum dynamical map from which we infer that V{t) is com- 
pletely positive if and only if G{t) > and T'„,„(t) > 
for all n ^ ni. Being the conditional transition probabil- 
ities of a semi-Markov process, the T„m{t) always satisfy 
of course the second condition. Hence we obtain the re- 
sult that the quantum dynamical map V{t) is completely 
positive if and only if the condition 



G{t) - ignrnit)) > 



(83) 



holds. This condition provides a full characterization of 
the complete positivity of the class of quantum semi- 
Markov processes given by Eq. ([77]) . 

Assuming the memory functions to be positive, the 
kernel ([T7)l is easily seen to be of the form introduced 
in Sec. IIII with the superoperator B{t) given by the 
completely positive map 



B{t)p = y^^TTjrmkn{T)\m){n\p\n){m\ 



(84) 



Hence we can apply condition (j69p as sufficient condition 
for the complete positivity of V{t). We note that the 
probabilities Tnn{i) are in general larger than the corre- 
sponding survival probabilities gn{t) — gnn{t), since the 
process can be in the initial state n at time t both because 
it has not left it and because it has come back to it. Ac- 
cording to Eq. ((8T|l the necessary and sufficient condition 
is therefore in general weaker than the merely suf- 
ficient condition (j69p . However, if the process involves 
only jumps in one specific direction, i. e., if the return 
probability vanishes for all states (this happens, e. g., for 
a purely decaying system), we have T„„(t) = gn{t) and, 
hence, condition (|69p becomes a necessary and sufficient 
condition for the complete positivity. 

An instructive special case is that of a translational 
invariant system for which fc„(T), gnm{t) and T„„(i) are 
state- independent, i. e. fc„(T) = ^(t), gnm{t) — g(t) and 
Tnn{t) = T{t). The conditions jM]) and ^ are then au- 
tomatically fulfilled, showing that any such translational 
invariant process leads to a completely positive dynami- 
cal map. The same conclusion holds true if we allow the 
memory function fc(r) to become negative. In fact, the 



kernel ([77|) is also of the form used in Sec. IHI C 41 with 
Bnij) given by 



Bnp = ^7r,„„|m)(n|p|n)(r 



(85) 



Condition ([75| is then also satisfied by assumption be- 
cause it reduces to the condition that the waiting time 
distribution /(r) corresponding to the memory function 
^(t) must be positive. 



2. Exponential memory functions 

Memory kernels of the form ([771) describe e.g. the dy- 
namics of a two-level system interacting with a bosonic 
quantum reservoir, such as for example a two-level atom 
coupled to a damped field mode. The index n now only 
takes on the two values -f and — and the memory kernel 
reads 



1C{t)p = fc+(r) 

+ fc-(T) 



(T+pcr_ - i {cr_cr+,p} 



(86) 



where the jiunp probabilities are given by tt^ = tt ^ = 

1 and TT = '^++ = 0. A typical expression arising for 

the time dependence of the memory functions is given by 



fc±(r) = K±e 



(87) 



with decay constants k± > 0. This expression also allows 
an explicit evaluation of the relevant quantities such as 
the functions gnm (t) and the conditional transition prob- 
abihties Tnmit). Inverting Eq. ([3T|) to obtain 



/±(") = 



k±iu) 
u + k±(u) 



and further calculating the inverse Laplace transform one 
finds the functions 

/±(r) = 25±e-^^/2 sinh(rf±r/2) (89) 
d± 



with 



d± = v^72 - 4k±. 



(90) 



The functions f±{T) are positive and normalized to one 
(or identically zero) if and only if 



> max{K+, K-}, 



(91) 



so that only in this case they can be interpreted as wait- 
ing time distributions and the generalized master equa- 
tion corresponding to Eq. describes a classical semi- 
Markov process. In fact under the condition 7^ > 4k+ 



10 



the function /+ (r) can be expressed as a difference of two 
exponentials as in (j39p with the identifications 



Al,: 



7^1 



4kj 



(92) 



thus corresponding to a generaUzed Erlang distribution, 
and similarly for the function J-{t). 

The conditional transition probabilities for the asso- 
ciated semi-Markov process can be calculated observing 
that due to Eq. ([79]) the quantity T^+{t) is given by the 
solution {t) of the master equation obtained with the 
initial condition p_(_+(0) = 1 and similarly for T--(t). 
Starting from Eq. ((86|) one has the equation 



P++{t) 



[k^{t - t)p^^{t) -k+{t- r)p++(T)] 



(93) 

Differentiating this equation with respect to time and 
exploiting the exponential form of the memory functions 
(157)1 together with the trace preservation one is led to a 
telegraph equation of the form 

P++ (t) + 1P++ (t) + (k+ + )/9++ (t) - K- = 0. (94) 

Its solution with the initial conditions p++(0) — 1 and 
/9++(0) = gives the conditional transition probability 
r_|_+(t), and an analogous calculation can be performed 
for T__(t). The results read 



T++{t) =- 



T-{t) =- 



+ 



-7*/2 



cosh{dt/2) + ^ sinh((it/2) 



+ K- 



cosh(di/2) + ^ sinh(dt/2) 



with 



d = - 4(k+ + K_). 



(95) 



(96) 



Note that despite the fact that d is not necessarily real, 
since this is generally not implied by Eq. (j9ip . the tran- 
sition probabilities themselves are always positive. 

For the memory functions (|87p one can also exactly cal- 
culate the entries of the matrix G{t) considered in ([69]) . 
In fact both g++{t) and g--{t) due to and the expo- 
nential form of the kernel have a second derivative which 

obeys a telegraph equation, and similarly for g-\ [t) . The 

corresponding solutions read 



<7++(t) = e--*/2 
5-(t) = e--*/^ 



cosh(d+i/2) + ^ sinh(<i+t/2) 
cosh(d_i/2) + ^ sinh(d_i/2) 



(97) 



and 

g+_(^)=e"'^*/^ 
with d± as in Eq. ([50)1 while 



cosh(dt/2) + -Lsmh{dt/2) 
d 



V72-2(k+ + k_). 



(98) 



(99) 



In particular (t) — g |_ (t) since it is a real quantity. 

Note that indeed minus the derivative of .g++(t) is equal 
to /+ {t) , according to its interpretation as survival prob- 
ability, and similarly for g (t) and f-{t). This entails 

in particular that both g++(t) and g--{t) are positive 
non-increasing functions taking the value one for t = Q. 

One can check that as discussed in Sec. IIII D 11 indeed 
the inequality Tnn(t) > gnnit) generally holds with n — 
±. In fact the quantity T„„(t) — gnn{t) is equal to zero 
for t — and has a non-negative derivative with respect 
to time for all values of the parameters complying with 
Eq. (pij) . This is consistent with the interpretation of 
the Tnn{i) as conditional transition probabilities which 
must be larger or equal to the corresponding survival 
probabilities. In particular one immediately sees from 
the explicit expressions ([M)) and ([W]) that for k_ = 0, so 
that one only has transitions in one direction, T^^it) ~ 

.g++(t) andT__(t)=5__(t) = l- 

The necessary and sufficient conditions for complete 
positivity of the dynamics described by Eq. ([55]) accord- 
ing to the general result Eq. ([83]) are thus given by 

T++(<)r__(t) >g%(t), (100) 

together with the constraint ([OT]) , which ensures that the 
populations obey a generalized master equation describ- 
ing a classical semi-Markov process. One therefore has 
to find out the possible range of parameters k+, k_ and 
7 for which the inequality Eq. pOOp is satisfied for all 
times, or at least up to a certain time. The task of find- 
ing conditions for complete positivity of the dynamics 
given by Eq. (|86p is indeed far from trivial and has been 
accomplished only partially in the literature [1, [2l| . 

Taking the explicit expressions ([95]) and ([97]) into ac- 
count and noting that for t — Q Eq. (I100|) is actually an 
equality, one can look at the short-time behavior of the 
quantity 



T++{t)T^^{t) 



r± 



it)- 



(101) 



In view of the constraint Eq. ([9T|) the fimction A is most 
conveniently expressed in terms of the rescaled quantities 

4 

T 



(102) 



bound to the interval [0, 1], and r = 'yt. In terms of these 
new variables A can be written as 



A(r) 



(103) 
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r_ 



FIG. 1: The sign of A(r) plotted for r = 0.01. Within the 
white region A is positive, while it is negative in the black 
regions. The range of r± is restricted to [0, 1] according to 
the constraint (1911). 



where 



/ii(t) = cosh (2^1 - {r- +r+; 



sinh(§^l- (r_ +r+)) 
v/1- (r_ +r+) 



(104) 



and 



/J2(r) = cosh(^Vl-(^-+'^+)/2) 
sinh(fv/l-(''-+r+)/2) 

The Taylor expansion of A for small r reads 
96 

so that whenever 

ri + - 4r I r_ > 



(105) 



(106) 



(107) 



one has violation of complete positivity for very short 
times. This is obviously the case for either r_ = 0, 
r+ > or r+ = 0, r_ > 0. The function A is plotted in 
Fig. [T] in the region allowed by Eq. (pij) , still clearly tak- 
ing on negative values. Note that in standard physical 
situations one has r+ > r_, which corresponds to posi- 
tivity of the reservoir temperature. Indeed the condition 
r_ = would correspond to a zero temperature reservoir. 
This remark confirms a result obtained in a completely 
different way in (2lj |. 

For r_ > the inequality (|107|) can be rewritten as 



1 > 0, 



(108) 



which is satisfied whenever 

r+ < (2 - %/3)r_ or r+ > (2 + %/3)r_. (109) 

In these parameter regions, even when the classical con- 
dition Eq. ((9T|) holds, the necessary and sufficient condi- 
tion Eq. (jlOOp for complete positivity is violated for very 
short times. Assuming as discussed above r+ > r_ we 
have thus obtained that the decay constants must satisfy 
the constraint 



< r+ < (2 + \/3)? 



(110) 



so as to avoid loss of complete positivity for very short 
times. A numerical analysis indicates that in this pa- 
rameter region the inequality Eq. (jlOOp is satisfied, cor- 
responding to preservation of complete positivity. Indeed 
the triangular white region in Fig. [1] which corresponds 
to positivity of the quantity A and therefore to fulfilment 
of the condition pOOp . gets larger with growing time. In 
Fig. [2] the quantity A is plotted as a function of r and 
of the ratio r_i_ / r . For the case of the spin-boson model 
considered in [21|, where the decay constants k± are ex- 
pressed in terms of the mean number of excitations of 
the reservoir at the frequency lo of the two-level system, 
taking Eq. p02p into account the constraint Eq. (jllOp is 
equivalent to 



(3huj < ln(2 + %/3). 



(Ill) 



The time evolution is therefore completely positive only 
for reservoir temperatures above a certain threshold given 
by ksT « O.Shuj. 




2 + V3" 



r+/r_ 



FIG. 2: (Color online) The quantity A plotted as a function 
of T and of the ratio between the decay constants in the range 
[1, 2 + ^/3]. r_ is fixed to be 0.2. 



In particular for r+ = r_ , which corresponds to an infi- 
nite temperature reservoir, complete positivity is granted 
on the basis of the classical condition Eq. ((9T|) only, 
as already discussed in Sec. IIIID H and confirmed by 
other approaches [1, [2l[. In fact in this case T++(t) = 
r__(i) = T{t) and g++{t) = g—{t) = g{t), so that 
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the condition (|100p reduces to T{t) > g{t), which in our 
approach is automatically known to be true because of 
the probabilistic interpretation of the quantities involved, 
and corresponds to the inequality (22) in Ref. [2l|. 

IV. CONCLUSIONS 

We have constructed a quantum mechanical general- 
ization of the classical concept of semi-Markov processes 
and discussed the basic features of the resulting quantum 
semi-Markov processes, including, in particular, the for- 
mulation of mathematical criteria for the complete pos- 
itivity of the corresponding quantum dynamical maps. 
The main motivation of our study was the development of 
a structural characterization of non-Markovian dynamics 
for a large class of quantum processes that is relevant for 
physical applications. The approach followed here could 
indeed be particularly useful in applications for which a 
microscopic system-environment approach is technically 
too complicated or impossible, guiding the phenomeno- 
logical construction of the memory kernel. 

It it important to stress that the class of quantum semi- 
Markov processes considered here do contain the Marko- 
vian limit as a straightforward special case as shown at 
the end of Sec. IIII CI thus providing a natural gener- 
alization of quantum Markov processes. In our deriva- 
tion of the various conditions for complete positivity we 
have made some specific assumptions in order to obtain 
explicit constraints. For example, we have assumed a 
certain structure for the Hamiltonian part and for the 
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